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ABSTRACT 



In the tenninal A, the input image ^ABC* is displayed in a 
window 2MA, with a rectangular frame 206Aindicating the 
area of transmission. The image in the transmission area is 
enlarged, and transmitted to the terminal B after compres- 
sion. Id tiie terminal B, the input image **cfghLf* is displayed 
in a window 200B, with a rectangular frame 206B indicating 
the area of transmission. The image in the transmission area 
is enlarged, and transmitted to the terminal A after compres- 
sion. In the terminal A, the image in a selected area (display 
area) of the received image is displayed in a window 202A 
Also a window 2MA displays the position and size of the 
display area within the entire received image. The transmis- 
sion area of ttie input image and the display area of the 
received image can be mlarged, reduced or displaced. 

13 Claims, 6 Drawfaig Sheets 
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COMMUNICATION APPARATUS 
WITH nO'£RACTIV£ OPERATOR DISPLAY 

This is a continuation of application Sec No. 08/068^46, 
filed on May 27, 1993 now abandoned. 5 

BACKGROUND OF THE INVENTION 

1. Held of tile Invention 

The present invention relates to an image conununication 
q)paratus, and more speciiically to an image comniunication 
i^>paratus ad^ted for Qse in a TV telephone system or a TV 
conference system. 

2. Related Background Art 

The communication standards for the TV teleph one sys- 
tem are recently being investigated by the CCTTT, and the 
image communication tfarou^ tiie public digital channels, 
the private digital channels and the inter-con^uter network 
systems are under development 

HG. 2 is a block diagram of a moving image processing ^ 
unit of aTV telephone apparatus constituting a conventional 
exanqde, as a reference to tiie present invention. A video 
camera 10 takes the image of a speaker or a document, and 
a moving image compressing dicuit 12 compresses the 
ou^Qt of the video camera 10 and transmits it to a dcstina- 
tioD unit. A compressed image received from such a desti- 
nation unit is e;^anded in a moving image e3q)and/decoding 
circuit 14, in which the received image is reproduced. 

A seledion/compositton circuit 16 selects or synthesizes 
(for exaiXQ>le pictnre-in-picture) the output (input image) of ^ 
the video camera 10 and the output (received image) of the 
moving image e3q>and/decoding circuit 14, and supplies a 
monitor 18 with the selected or synthesized image signal 
For die purpose of explanation, the input image to the video 
camera 10 is assumed as '^ABCT* and the image received 
from the partner unit is assumed as "efghij**. The monitor 18 
is displaying a picture-in-picture image synthesized by the 
circuit 16, with the received image as a mother image and 
the input image from .the video camera 10 as a daughter 
image. ^ 

Hie selection/composition circuit 16 utilizes a commer- 
cially available picture-in-picture IC, and is usually 
provided, in addition to the above-mentioned function, with 
functions interchanging the mother and daughter images 
and moving tihe daughter image to four comers of the image ^ ^ 
frame. 

In the conventional image communication apparatus, par- 
ticulady tiie TV telephone apparatus, the input image is 
directly transmitted to tiie partner unit and is displayed on 
the monitor thereof, and the video camera 10 is so adjusted 50 
to take a narrow shot, witii the face of the speaker at the 
center. 

In such conventional TV telephone apparatus, the users 
mutually converse while observing the received image and/ 
or the input image displayed on the monitors 18. As a result, 35 
since the attention of the user is concentrated on the moving 
image display on the monitor 18, his viewing field becomes 
narrower than in the ordinary conversation by voice only, 
and he may not notice the change taking place behind him. 

Also in the TV telephone apparatus, or in a terminal of the 60 
TV conference system, the speaker has to intentionally 
adjust the direction of his face, wfaHe observing the input 
im^e. In order to avoid such tediousncss, some video 
cameras 10 are given a swinging mechanism, but the speaker 
has to reach for tiie video camera in order to vary (he angle 65 
thereof. A remote control unit for this purpose is not cost 
effective for use by each speaker. 
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Also in case there are plural speakers in the same 
apparatus, as in the TV conference, it is sometimes desirable 
to switch the shot of ail the attendants and the shot of an 
ittdividnal speaker in the transmission to the partner appa- 
ratus. However, for such purpose, there are required a 
mechanical mechanism and an optical zooming mechanism, 
so that tiie control becomes moie con^lex. 

Also in the received image, it is sometimes desired to 
magniiy a part of the received image, such as a document or 
a model, in the course of the communication. In the con- 
ventional £^>paratus, such partial magnijication is achieved 
by providing a zocHnlng mechanism and a swinging media^ 
nism at the transmitting side, so that the terminal becomes 
complex and expensive. 

SUMMARY OF THE INVENTION 

An object of the present invention is to provide an image 
communication apparatus c^blc of individually or collec- 
tively resolving the above-mentioned drawbadcs. 

Another object of tiie present invention is to provide an 
image communication apparatus capable of arbitrarily 
selecting the image to be synthesized, without replying on a 
conq>lex cottfiguratioiL 

StiU another object of the present invention is to provide 
an image communication ^aratus capable of providing a 
partial magnified image, from an image represented by 
image data received from another unit 

^ill another object of the present invention is to j^ovide 
an image communication apparatus capaUe of arbitrarily 
selecting the area of an image rqxresented by image data to 
be transmitted to another unit 

The foregoing objects can be attained, according to a 
prefened embodiment of the present invention, by an image 
communication a^xoatus composing extraction means for 
extracting a transmission area sdected from an input image 
and varying the size of die area to a predetermined size, 
transmission means for compressing the output image of the 
extraction means and transmitting the output image to other 
unit, and display means for displaying the iopat image 
togetiier with a mark indicating the sdected area, wherein 
the selected transmission area is arbitrarily variable and 
movable within the area <^ the input image. 

Still another object of the present invention is to provide 
an image processing ^)params with novel functions. 

Still another object of the present invention is to provide 
an image processing <x communication ai^Miratus improved 
in the convenience of use. 

Still other objects of die present invention, and the fea- 
tures tberoof, wHl become fully appmut from the following 
description of the embodiments, to be taken in conjunction 
with the attached drawings. 

BRIEF DESCRimON OF THE DRAWINGS 

FIO. 1 is an entire block diagram of an embodiment of the 
present invention; 

FK}. 2 is a schematic block diagram of a conventional 
configuration; 

FIG. 5 is a schematic block diagram of an image pro- 
cessing circuit 22 featuring the present invention; 

FIGS. 4A and 4B are views showing images stored in 
frame memories 42A and 42B; 

FIGS. 5A and 5B are views showing images stored in 
frame memories 44A and 44B; 

FIGS. 6A and 6B are views showing images stored in 
frame memories 46A and 46B; 
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FIGS. 7A and 7B are views showing images displayed on The window display control drcuits SOj 52, 56 are 

monitors 24A and 24B; so-called memory control circuits, which control the signal 

FIGS. 8A and 8B are views showing graphical ou^ut write-in and read-out of the frame memories 42, 44, 46 by 

images stored in gr^Mcal memories 82A and 82B; means of memory address signal lines 58, 60, 62 and 

FIGS. 9A and 9B are views showing images stoned in 5 memory control signal lines 64, 66, 68. The pixel data read 

frame memories 42A and 42B; from the memories 42, 44, 46 are supplied to (he window 

FIGS. lOA and lOB are views showing images stored in display control circuits 50, 52, 56 througjh pixel data lines 

frame memories 44A and 44B ; 70, 72, 74. The image data of an arbitrarily selected area can 

FIGS. IIA and IIB are views showing images stored in be read from the frame memories 42, 44, 46. The window 

frame memories 46A and 46B ; lo display control circuits 50, 52, 56 are controlled by the CPU 

FIGS. 12A and 12B are views showing images displayed 32 through a control bus 75. 

cm monitors 24A and 24B; and por the signal writing into the frame memories 42, 44, the 

FIGS. 13A and 13B are views showing grairfucal output window display control circuits 50, 52 receive a clock signal 

images stored in gr^hical memories 82A and 82B. ftom the dock generator 38, and, for the signal writing into 

DETAILED DESC3EaFnON OF THE *c frame memory 46, the window display control circuit 56 

PREFERRED EMBODIMENTS receives a dodc signal from the clock generator 40. 

Now flie present invention will be clarified in detaU by ^ transnaission sync signal generator 76 gaierates syn- 
preferred embodiments thereof shown in the attached draw- chronization signals (horizontaWertical sync signals, blank- 
ings. In the following description, a signal line and a signal i'^g signal and pixel data clock) for reading the image data 
thereon arc rqjrcscntcd by a same reference number. ^ ^ memory 42 for siqjply to the compression encoding 

FIG. lis a schematic block diagram of an embodiment of circuit 26. A post-processing drcuit 78 effects a post- 

the present invention, wherein a video camera 20, for taking processing on tiie R, G, B data from the window display 

the image of a speaker etc., sends the output (input image) control circuit 50 accwding to the ou^uts of the drcuit 76, 

to an image processing circuit 22. The circuit 22, also is composed of a color space transformation circuit, a 

receiving a received image, selects or synthesizes selected luminance^color difference encoder, a sync signal muMplex- 

portions of the input and received images for supply to a ing circuit and a D/A converter. The outputs of the circuit 76 

monitor 24, and suppHcs a compression encoding drcuit 26 supplied to the window display control circuit 50, 

witti the selection portion of the ii^Hit image. The circuit 26 purpose d signal reading from the memory 42. 

effects compressi(Hi encoding of the sdection portion of the A graphic image display control circuit 80 generates a 

input image supplied from the image processing drcuit 22, badcground image in die display on the monitor 24 and also 

and the compressed moving image information is transmit- generates sync signals for display on the monitor 24. the 

ted to a partner unit through a oommunic^n control drcuit circuit 80 is connected to a graphic memory 82 through a 

28 and an ISDN line. memory address signal line 84, a memory control signal line 

The compressed moving image infcsmation^ transmitted 35 ^ ^ *^ tenqwrarily stores tiie graphic 

from the partner unit, is supplied through tiie communica- image data, as pal^ data, in the graphic memory 82. 

don control circuit 28 to an expansion decoding circuit 30 The sync signals generated by tfie drcuit 80 are supf^ed 

for e^ipansion decoding, and the reproduced image from tiie to the window display control circuits 52, 56 through a 

drcuit 30 is supplied, as explained above, to the image synduonization signal line 90, for the signal reading frcxn 

"processing circult"22: ~ ^ memories 44, 46, and-also^sirppHed to a pixel data 

A CPU 32 controls the image processing circuit 22, tiie selection processing drcuit 92 to be explained later and the 

oonqxression encoding circuit 26, the cormnunication control monitor 24. 

drcuit 28 and the expansion decoding drcuit 30, according The control circuit 80 sends the pixel data (palette data), 

to the in^ructions of the user given dirough an operation unit read from the graphic menoory 82, to the window display 

31 and also according to the status of comnuinication 45 control drcuits 52, 56 and a palette memory 96 through a 

obtained from the communication control drcuit 2& pixd data line 94. As will be explained later in more details, 

FIG. 3 is a block diagram of the image processing drcuit the palette data 94 determine, in the unit of each pixel, 

22. Eadi of preprocessing circuits 34, 36 is composed of an whether or not to display the input and received images in 

A/D converter, a synchronizatLon signal separating circuit, a the display windows thoefor. Hie palette mtemory 96 con- 

Immnancc/color difference component decoder and a color so the palette data 94 from the graphic display control 

space transformation calculator, and converts an analog drcuit 80 into R, G, B data for supply to the pixel data 

input image signal fix)m the video camera 20 or an analog selection processing dront 92 through a pixel data Une 97. 

received image signal from the expansion decoding drcuit The control circuit 80 is enable of setting and varying die 

30 into digital R, G and B data, according to a dodc signal content of the palette memory 96 through a control line 98. 

from a dock generator 38 or 40. 55 The window display control drcuit 52 supplies the pixd 

Hie R, G, B data (input image) from the preprocessing data selection processing drcuit 92 with the R, G, B data 

drcuit 34 are supplied to frame memories 42, 44 while those read from the frame memory 44 through a data line 100, and 

(recdved image) from die drcuit 36 are supplied to a frame sends an enable signal, indicating whether effective 

memory 46. The frame memories 42, 44, 46 are con:q)osed pixd data are present on the data line 100, to an enable 

of ordinary dual port RAM's. Also the preprocessing drcuit 60 signal line 102. Similarly the window display control circuit 

34 sends horizontalArertical synchronization signals, a 56 supplies the pixel data sdection processing circuit 92, 

thanking signal and an off^even fidd identification signal, widi the R, G, B data read from the frame memory 46 

obtained by extraction, to window display control drcuits through a data line 104, and sends an enable signal, indi- 

50, 52 through a synchronization signal line 48, whUe the eating whether effective pixel data are present on the data 

preprocessing circuit 36 sends similar signals to a window 65 Une 104, to an enable signal line 104. 

display control drcuit 56 throug;h a syndironization signal The pixel data sdection drcuit 92 selects or synthesizes 

line 54. the R, G, B pixel data 100, 104 from the window display 
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control dicuits 52, 56 and G, B pixd data SI £rom the 
palette memory 96 far supply to the D/A converter 108. The 
pixel data selection processing circuit 92, according to the 
setting of various processing parameters by the CPU 32 
through the control bus 75, executes the selection or syn- 
thesis in synchronization with a sync signal 90 from the 
graphic di^lay control circuit 80. The D/A converter 108 
converts the pixel data from the pixel data selection pro- 
cessing circuit 92 into an analog signal, foe supply to fte 
monitor 24. 

In the following explained is the function of ttie circuits 
shown in FIG. 3. The iiq>ut image from the video camera 20 
is supplied to the pre-pn>cessing circuit 34, which executes 
&e pre-processing of the analog input image signal in 
synchronization with the dock signal from the dodc gen- 
erator 38 and releases ^ G, B pixel data and the 
separated synchronization signals. The pixd data are sup- 
plied to the frame memories 42, 44 while the separated 
syndironization signals arc supplied to the window display 
control circuits 50, 52. 

The received imag& from the expand/decoding drcuit 30 
is supplied to the pre-processing circuit 36, which executes 
the pre-processing of the recdvcd analog image signal in 
syndkronizati(»i with the dock signal from the clock gen- 
erator 40 and releases the R, G, B pixd data and the 
separated synchronization signals 54. The R, G, B pixd data 
are supplied to the fr^une naenuxy 46, while the separated 
synduonizaticm signals are supplied to the window display 
control circuit 56u 

The window display control circuits 50, 52 write the R, G, 
B pixel data (input image) from the pre-processiDg circuit 34 
into tiie frame memories 42, 44 accordin g to the dock signal 
from the dock generator 38 and the synchronization signals 
48 separated in the pre-processing circuit 34, while the 
window display control circuit 56 writes tiie R, G, B pixd 
data (received image) from the pre-processing drcuit 36, 
into the frame mcmary 46 according to the dock signal from 
the dock generator 40^ and.thc-synchronization . signals 
separated in tiie pre-processing circuit 36. 

Each of the frame memories 42, 44, 46 is c^afaie ^ 
storing die R, G, B pixd data of a frame. The CPU 32 is so 
designed as to be capable of causing, through the control bos 
75, the window diqjlay oontrd circuits 5f, 52, 56 to start and 
interrupt the data writing into the frame memories 42, 44, 46 
at an artsitraiy timing; When the writing is interrupted, the 
pixd data constimting a still frame at the timing of the 
interruption are stored in the memories 42, 44, 46. 

Hie fr:ame memccies 42, 44, 46 can store the image data 
of still frames supplied from the outside, by way of the 
control bus 75, the window disfrfay control circuits 50,. 52, 
56 and die data lines 70, 72, 74, and the image data of still 
frames stored in the frame memories 42, 44, 46 can be 
released to the outside by way of the data lines 70, 72, 74, 
the window display control drcuits 50, 52, 56 and the 
control bus 75. 

The input image stored in the frame memory 42 is 
processed in the following mannet TTie CPU 32 sets a 
cut-out area, sdccted by the user, in the window display 
control circuit 50 tiirough the control bus 75. The oontrd 
circuit 50 reads the pixd data within the cut-out area from 
the frame memory 42, and the data are supplied through die 
window display amtrol circuit 50, which effects a variation 
in the m agni fi cation (data skiing and interpolatioii) on die 
read image data so as to obtain an image of a predeteimined 
size, and sends thus processed data to the post-processing 
circuit 78, aocarding to ttie synchronizalion signals from the 
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transmission sync signal generating circuit 76. The method 
of such variation of magnification itself is already known. 

The cut-out area from the frame memory 42 and the image 
magnification can be varied even during die operation, and 
5 the window display control circuit 50 adopts the new cut-out 
area and the new image magnification, in syndironization 
widi the syndironization signals frcHU the transmission sync 
signal generating circuit 76. 

The post-processing circuit 78 effects die post-processing 
on the R, O, B pixd data from the control drcuit 50, in 
synchronization with the syndironization signals from the 
generating circuit 76, and the resulting output is supplied to 
the compression encoding circuit 26 and transmitted to the 
partner unit 

The input image stored in the frame memory 44 and the 
received image stored in the frame memory 46 are processed 
in the fdlowing manner. The CPU 32 sets the cut-out areas 
of the input and received images and die position and area 
of the di^lay window on the monitor 24, instructed by the 

^ user, in the window display contrcd circuits 52, 56 through 
the control bus 75. The window display oontrd circuits 52, 
56 also recdve, from the gr^hic display control circuit 80, 
the palette data 94 ydiicfa determine, for each pixel, whether 
or not to display the input andrecdved images of tfie cut-out 
areas in the display window on the monitor 24. 

In synchronization with the synchronization signals 90 
from the graphic display control circuit 80, the window 
display contrd circuits 52, 56 read the pixd data of the set 
cut-out areas from the frame memories 44, 46, and thus read 
pixd data are sullied, through the data lines 72, 74, to the 
window display control circuits 52, 56, which vary the 
magnification of die pixd data, read from die memories 44, 
46, to die predetermined size of the display window (by 

3j skq>ping and interpolation) and send the data to the pixd 
data selection circuit 92 through the data lines 100, 104. The 
control circuits 52, 56 also activate the enable signals 102, 
106 if, during the supply of the pixd data 100, 104 to die 

- pixd data selection circuit 92, die palette data comdde wldi - 

^ those preset in the circuits 52, 56. 

The cutrout areas from die frame memories 44, 46 and the 
image magnification are variable even during the operation, 
as in the case of Ihc frame memory 42, and the window 
display control circuits 52, 56 adopt the new cut-out areas 

45 and die new magnifications in synchronization with the 
synchronization signals from the ^z^tac display contrd 
circuit 80. 

The user can instruct the posititHi, area and cut-out area of 
the display window for die input and received images to the 

50 CPU 32 by an unrepresented operation unit, for example a 
pointing device such as a mouse, and the instructed infor- 
mation is transferred, diroug^ the control bus 75, to die 
graphic display control drcuit 80, whidi prepares a graphic 
image fraine by ineans of predeternuned palette data accord- 

55 ing to die entered instructed information and stores the pixd 
data of the image frame in the graj^c memory 82. Thus the 
graphic image frame data stored in the graphic memory 82 
correspond, one-to-one, to the display windows on die entire 
image frame of the monitor 24. 

60 The graphic display control circuit 80 reads the graphic 
image frame data from the gr^hlc memory 82 according to 
the intexnal synchronization signals, and sends the data 
dirough the data line 94 to the window display contrds 
drcuit 52, 56 and a palette memory 96, and further supplies 

65 the window display control circuits. 52, 56 with synchroni- 
zation signals 90 synchronized with the internal syndironi- 
zation signals. The palette memory 96 converts the palette 
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data, from the graphic display coatrol drcuit 80, into G, to be transmitted, and, in the received image display area 

B pixel data for supply to the pixel data selection circuit 92. indicating windows 2#4A, 204B, there are displayed rect- 

The CPU 32 is capable of controlling the graphic display angular frames 208A, 208B indicating the areas cut out for 

control circuit SO through the control bus 75, and the control display in die received images. 

drcuit 8# can vary the selection of the conversion table of 5 ^oc facilitating die understanding, in FIGS. 4A and 4B, 

the palette data 94, according to a control signal 98. Thus the lectangular frames 206A, 20€B indicating tfie areas of 

user can selects die window display frame or the background transmission of the input images arc supcrposcdly shown, 

image of the input and received images. rectangular frame 208A indicating the 

The pixel data selection processing circuit 92 selects the supeq>osedly Olus- 

R, G B phd data IM IM fr^^^ control ^ corresponding to the windows 200A, 

arcmts 52 56 and the G B pixel dam 97 from thepalete ^OOB to 208A, 208B are sW i^ the graphic memory 82! 

memory 96, according to the ^nchronizahon signals 90 in the gnipMc memory 82, con-espondingtb the input image 

from the ^aphic display control circuit 80, and sends the display windows 200A, 200B, there are stored palette^ 

selected data to a D/A converter 108, for displaying a surrounding window frame, and the interior 

Basically, the pixel data selection processing circuit 92 thereof is compl^y filled with palette data of a palette 

selects the pixel data 100 when the enable signal 102 is number PI for indicating the input image display area to the 

active, or the pixel data 104 when the enable signal 106 is window display control circuit 52. Corresponding to the line 

active, or the pixel data 97 when the enable signals 102, 106 portions of the rectangular frames 206A, 206B, there are 

are bodi inactive. When the enable signals 102, 106 arc botii stored palette data different from those of the number PI. 

active, the data 100 or 106 are selected according to the ^ Similarly in die graphic memory 82, corresponding to the 

priority set by the CPU 3Z Naturally there may be selected received image di^Iay windows 202A, 202B, there arc 

the result of logic calculation, sudi as AND or OR, of the stored palette data for displaying a window frame around die 

data 97, 100 and 104. areas, and the interior of the area is filled with palette data 

The D/A converter" 108 converts the R, G, B pixel data, „ °f ^.^^^"^ ™^ ^J""' mdicating the rccdved image 

suppHed from the pixel data selection drcJit 92, intT^ ^ "^f^^^ Z^^.^^ di^hiy control arcmt 56. The 

1 • 1 r t. * it. •* !_ . . window display control CQ-cuits 52, 56 respectively store the 

^alog signal for supply to the momtar 24, which, reoeivmg nurOxk PL P2 in advance. 

t!J7^T2S°H'if'^*K • ^^.f^^ .^"^^^ Also in the areas corresponding to die area displaying 

control circuit 80, displ^s tiie image of the output image windows 204A,204B, data of a palette number are stor^ 

signal of die D/A converter 108 accordmg to the synchro^ 3^ displaying the window frame around the areas, and, in case 

mzation signals. received images are cut out, tfie line portions (or die 

In the following there will be given a detailed explanation entire intericffs) affile cut-outframes 208A, 20^ are stored, 

on the input image and die cut-out area (transmission area) At first, the input image "ABC of die terminal A is 

ttiereof , and the received image and the cut-out area (display processed in the following manner. The input image **ABC*, 

area) thereof, in case of image communication between 35 obtained by die video camera 20A of the terminal A, is 

terminals A and B. Terminals A and B correspond to operator stored in the firame memories 42A, 44A as pixel data with 

and partner terminals, respectively. It is assumed that an effective pixels 640Hx480V, as shown in FIGS. 4Aand5A. 

image "ABC is entered in the terminal A, while an image The CPU 32A sets, in die window display control circuit 

"efghif is entered in the terminal B. In die f blowing 52A through die control bus 75, die X,Y coordinates of die 
description, when the ciraiit in the tcnninal A and that in the- ^ cut^t area from the firanie iiiEmOTy '44Arthe X^^ 

te rmin al B have to be deady identified, the circuit in the nates of the position, area and magnification of the input 

terminal A is indicated by a suflHx A, and vice versa. image display window 200A in the ou^t graphic image 

It is assumed, in the terminals A, B, that the input image frame, and die palette nunibcr PI assigned for the input 

of the video camera 20 has effective pixels of 640 image display. In the example shown in FIGS. 4A to 8B, in 

(honzontal)x4SO (vertical), and that the monitor 24 has a 45 the terminal A, the entire input image is displayed in the 

resolution or a display ability of 1024 (horizontal)x768 input image display window 200A. Therrfore, if the input 

(vertical). The gra(^c memory 82 can store graphic image image display window 200A contains pixels of 3 60Hx270V, 

data corresponding to the resolving power of the monitor 24. the image magnification will be 9/16. 

FIGS. 4A to 8B illustrate an example of the processing The window display control circuit 52A reads the pixel 

executed in die image i^ocessing circuit 22, wherein FIGS. 50 data in the cut-out area from the frame memory 44A, then 

4A and 4B; 5A and 5B ; and 6A and 6B respectively show the effects a skipping or interpolating operation corresponding 

image data stored in the frame memories 42, 44, 46 of the to the image magnification of 9/16, and releases the pixel 

terminals A and B , while FIGS. 8 A and 8B show the gr^hic data after the variation of image magnification to a pixel data 

image data stored in die graphic memories 82. For fadli- line lOOA. The enable signal 1#2A is made active if the 

tating the understanding, the data are shown in die form of 55 palette data 94A are PI during the data output 

an image. In this example, the input image is entirely During the active state of the enable signal li2A, die 

displayed on die monitor 24 of the unit of the input side. pixel data selection circuit 92A selects the pixel data lOOA 

In this embodiment, as shown in FIGS. 7A and 7B, there from the window display control drcuit 52A. Thus the area 

are set at least diree display windows on the monitor 24: ie. of the input image display window 200A in the graphic 

input image display windows 200A, 200B for displaying the 60 image frame, stored in the graphic memory 82A, is r^laced 

entire input images; received image display windows 202A, by the cut-out portion of the input image from the window 

202B for displaying selected parts of die received images; display control circuit 52A, and die gr^hic image frame is 

and received image display area indicating windows 204A, supplied through the D/A converter 108A to the monitor 24A 

204B for displaying the positional relationship of the dis- and displayed thereon as shown in FIG. 7A. Naturally the 

played areas in the entire received images. In die input 65 frame 2#6A indicating die cut-out area for transmission of 

image display windows 200A, 200B diere are displayed the input image is not replaced and is displayed on die 

rectangular frames 206A, 206B indicating the cot-out areas monitor 24A. 
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The transmissioii of the input image ''ABC* is coaducted The CPU 32B sets, in the window display control dicait 

in the following manner. The CPU 32A sets , in the window 52B through the control bus 75B, the Y coordinates of the 

display control 50Aof the terminal A through the control bus cut-out area from the frame memory 44B, the X, Y coordi- 

75A, the X, Y cocxtlinates of the cut-out area from the frame nates of the position and area of the input image display 

memory 42A, and the estimated size and image magnifica- 5 window 200B in the output graphic image frame, ttie image 

tion of the ou^ut display image frame. In the example magnification and the palette number PI assigned for input 

shown in FIGS. 4A to 8B, the transmission is executed in an display. In the cxanmle shown in FIGS. 4A to 8B, the 

area of 400Hx300V having Ae center on the character ^ ^ tenninal B is displayed in the iimut 

of the input image "ABCT, and^tf Ac ^tiimted output ^ ^ ^„ ^ t 

display mjage tone has assize of 640Hx480V, the image ^ ^^^^ ^ ^ 

magmficatxonwmbel6/m , . , malnmcation will be 9/16. 

The wmdow display control circuit 50A reads the mxel r . ^. , ... , , . , 

data in the cutout area from the frame memory 42A, then The wmdow display control aicuit 52B reads the pixel 

effects the skipping^ntapolating calcalatioa corresponding ^ *^ cut-out area fr<Mn the frame memory 44B, then 

to the image magnification 16/10, and the pixel data after die effects a skipjnng/interpolating calculation ccKiesponding to 

variation <rf magnification (640 pixels per line times 480 ^ magnification 9/16, and sends the pixel data after 

lines) to the post-processing circuit 78A in synchronization *^ variation of magnification to the pixel data line lOOB, In 

with the sync signals from the transmission sync signal synchronization with the synchronization signals 90B from 

generating circuit 76A. The post-processing circuit 78A ^ graphic display control drcuit 80B. The enable signal 

effects flic post-processing on die entered pixel data, and flic 1*2B is activated if the palette data MB are PI during the 

analog moving image signal, obtained in die post processing ^ output. 

is coix^ression encoded in the cooqsression encoding circuit During the active state of the enable signal 102B, the pixel 

26A and transmitted to the terminal B. data selection dicuit 92B selects die pixel data lOOB from 

In this exan^e, since the cut-out area is 1(V16 in effective the window display control circuit 52B. Consequently, in the 

pixels in the input image, the rectangular frame 206A, graphic image frame stored in the grq[^c memoiy 82B, the 

indicating the cut-out area and displayed in the input image ^ area of the input image display window 200B is rq)laced by 

di^lay window 2MA, has a size of about 225Hxl69V. the cut-out image of the input image, supplied from the 

In the terminal B, die con^jrcsscd image data transmitted window display control circuit 52B, and the gnq>hic image 

from the terminal A are expanded in the expansion decoding frame is suppHed through the D/A converter lOSiB to the 

circuit 30B, and arc stored as image data with an effective ^ monitor 24B and displayed thereon as shown in FIG. 7B. 

pixel area of 640Hx480rv; in the frame mcmOTy 46B. The Naturally the frame 206B indicating the cut-out area for 

CPU 328 sets, in the window display control circuit 5tiB transmission in the input image is not r^laced and displayed 

throu^ the control bus 75B, the X, Y coordinates of the on the monitor 24B. 

cat-out area from the frame memory 46B, the X, Y coordi- The transmission of the input image "efghij** is executed 

nates of the position and area of the received image display ^ ^ in the following manner. The CPU 328 of the tenninal B 

window 202B in die ou^t graphic image frande, the image sets, in the window disfday oontrc^ circuit SOB through the 

magnification and die palette number P2 assigned fcx dis- control tnis 75B, die X, Y coordinates of die cut-out area 

]playing the received image. from die frame memory 42Bf die estimated size of the output 

=Jn the - terminal B ^ of this example ^ -the entire received - display, image frame and die, image., magnification. ^ .^dic , 

image is displayed in the received image display window ^ exan^)lc shown in FIOS. 4Ato 8B, the transmission is made 

202B. Thus the rectangular ficame 20$B indicating the in an area of 480Hx360V, with the center at die characters 

cut-out area coincides with the frame of die received image "tghi*" of the inputimage. In this case, if the esdnuited output 

display area di^laying window 204B. Consequendy, if die display image frame has a size of 64OHx4S0V, the image 

area of die received image display window 2©2B has a pixel magnification will be 16/12. 

area of 560Hx420V, the image magnification will be 14/16. 45 The window dist^ control circuit SOB reads pixel data 
The window display control circuit 5^ reads the pixel in die cut-out area from die frame memory 42B, then effects 
data in the cut-out area from the frame memory 4^, dten a skipping^teipolating calculation corresponding to die 
effects a skipplng^erpolating calculation corresponding to image magnification 16/12, and sends the pixel data after the 
the image magnification 14/16, and the pixel data after the variation of magnification (640 pixels per ]inex4S0 lines) to 
variation of magnification to the pixel data line lOOB, in 50 post-processing circuit 78B, according to the synchro- 
synchronization with the sync signals 90B from the gr^>hic nization signals from the transmission sync signal generat- 
dlsplay control circuit 8tB. The enable signal 106B is made ing circuit 7€B, The post-processing circuit 78B effects flie 
active if the palette data 94B arc P2 daring the data ou^t post-processing on the entered pixel data, and the obtained 
During die active state of tiie enable signal 106B, die pixel analog moving image signal is compression encoded in die 
data selection circuit ft2B selects die pixel data 1MB frcwn 55 conqiessioii encoding circuit 2^ and is transmitted to die 
the window display control circuit S€B. Thus, in the gr^hic terminal A. 

image frame stored in the gra^ifaic memory 82B, the area d In this example, since the cut-out area is 12/16 in the 

the received image display window 202B Is replaced by the effective pixels in the input image, the frame 206B, indi- 

image cut out from the received image and received from the eating the cut-out area, di^layod in the input image di^lay 

window display control circuit S6B, and the gr^hic image 60 window 200B, has a size of about 270HX203V. 

frame is supplied through the D/A converter ItSB to the In the tccminal A, the compressed image data received 

monitor 24B and displayed thereon as shown in HG. 7B. from the terminal B are expanded in die expansion decoding 

The input image **ef ghif* of the tenninal B is processed in circuit 30A, and are stored, as image data with an effective 

the following manner The input image **efghij"> obtained by pixel area of 640Hx480V, in the frame memoiy 46A. The 

die video camera 20B of the terminal B, is stored in the 65 OPU 32A sets, in the window display control drcuit S6A 

frame memories 42B, 44B as pixel data with effective pixels through the control bus 7SA, the X, Y coordinates of the 

640HX480V, as shown in FIGS. 4B and SB. cut-out area from die frame ipemoiy 4<iA, die X, Y coordi- 
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nates of the position and area of the received image display signal generating circuit 76A, The window display control 

window 202A in the ou^ut graphic image frame, the image circuit 50A reads the pixel data of the new cut-out area from 

magnification, and the palette number P2 assigned for the the frame memcfy 42A, then effects a skipping^terpolacing 

received image display. operation conesponding to the image m^ignification 16/10, 

In this example, the terminal A cuts out, from the received 5 and sends the pixel data after the variation of magnification 
image, an area of 320Hx240V with the center at the char- (640 pixels per linex480 lines) to the post-processing circuit 
actcr for display in the received image display window 78A according to tiie synchronization signals from the 
202A. Thus, if the frame memo3746A has an efifective pixel generating circuit 76A, The processes after the post- 
area of 640H x480V; then if the cut-out ai«a therefrom has processing circuit 78A are same as explained beft^e. 
a size of 320Hx240V and if the received image display to Withthe variation of the cut-out area for transmission, the 
window 20!2A has a size of 560Hx420V, the image magni- frame 2#6A for indicating the transmission area in the output 
fication will be (16/8)x(14/16). graphic image frame, stored in the graphic memory 82A, is 

The window display control circuit 56A reads the pixel also renewed to a new transmission area, and, on the monitor 

data in the cut-out area from the frame memory 46A, then 24A, the frame 206A is displayed, corresponding to the new 

effects a skipping^nteipolating calculation corresponding to cut-out area, in the input image display window 200A. 

the magnification (16/8) x( 14/16), and sends the pixel data In the terminal B, the image received from the terminal A 

after the variation of magnification to the pixel data line is processed as e:iplaiiked before and is displayed in the 

1<MA, according to the synchronization signals 90A sup- received image display window 202B. 

pUed from the graphic display control circuit 80A. The On the other hand, in the input image "efghij" of the 

enable signal 106Aismadeactiveifthepalettedata»4Aare 20 temjiaai B, the transmission area is made narrower from 

P2 during the data output. 400Hx300V to 240Hxl80V and its position is varied. The 

During the active state of the enable signal 106A, the CPU 328 varies the setting of the X, Y coordinates of the 

pixel data selection circuit 91A selects the pixel data i04A cut-out area from the frame memory 42B and the image 

from the window display control circuit S6A. Consequently, magnification, in the window display control circuit SOB 

in the graphic image frame stored in the graphic memory ^ through the control bus 75B. If the estimated output image 

82A, the area of the received image display window 202A frame has a size of 640Hx480V, the new image magnifica- 

is replaced by the cut-out image of the ii^)ut inaage, supplied tion will become 16/6. 

from the window display control circuit 56A, and the image The window display control circuit SOB reads the pixd 

frame is supplied through the 0/A converter 108A to &e data of the new cut-out area from the frame memory 42B, 

monitor 24A and displayed thereon as shown in FIG, 7A. ^ then ^ects a skipping/inteqM)lating operation ccnrespond- 

Ih the received image display area indicating window ing to the image magnification 16/6, and sends the pixel data 
204A of the terminal A, by the cut-out of the received image, after the variation of magnification (640 pixels per linex480 
the rectangular frame 208A is displayed, indicating the area lines) to the post-processing dicuit 78B, according to the 
cut-out for display in the received image. If said indicating synchronization signals from the transmission sync signal 
window 2WA has a size of 160Hxl20V, the rectangular generating circuit 76B. The processes after the post- 
frame 208A has a size of about 80Hx60V. processing circuit 7SB are same as explained before. 

In the following there will be exj^ained a state when die Also in the terminal B, with the variation of flic cut-out 

cut-out areas (transmission areas) of the input images area for transmission, the firame 206B for indicating the 

-ABC**, **irfgfaij" cf the traraodnal A, B and the' cut-out areas transmission area in the output graphic~im^e~;irea7 s 

(received areas) of the received images are varied from the the gr^hic memory 82B, is renewed to a new transmission 

state shown in FIGS. 4A to 8B. FIGS. 9A to 13B illustrate area, and, on the monitor 24B, the frame 206B is displayed 

me images after the variation, respectively corresponding to in the input image display window 200B, corresponding to 

FIGS. 4A to «B. In FIGS. 9A, 9B, HA and IIB, the a new cut-out area. 

rectangular frames 206A, 20fiB indicating the transmission 45 xhe inagc transmitted fix>m the terminal B to A is 

areas of the input images and the rectangular frame 208A expanded in the expansion decoding circuit 30A and is 

indicating the display area of the received image are illus- stored in the frame memoty 46A, as image data with an 

trated supeiposedly, as in FIGS. 4A, 4B, 6A and 6B. effective pixel area of 640Hx480V. It is assumed that the 

More specifically, in the terminal A, the cut-out area user of the terminal A dianges the display area of the 

(transmission area) of the input image **ABC* is shifted 50 received image from a left-side area of 320Hx240V to an 

from die position centered at "B" to the right to a position upper right area of 480Hx360V. With the variation, the CPU 

centered at •'BC, and, in the tenninal B, the cut-out area 32A varies the setting of the X, Y coordinates of the cut-out 

(transmission area) of the input image "cfjghij" is made area from the frame memory 46A and the image magnifi- 

narrowcr from tfie position centered at "fg^ii** to a position cation in the window display control drcuit 56A through the 

centered at *T'. Also in the terminal A, the display area for 55 control bus 75A. Marc specifically, the cut-out area is 

the received image is made wider. These instructions are changed to 480Hx360V, while the frame memory 46A has 

given from the aforementioned operation unit 31. an effective pixel area of 640Hx480V, and tiie received 

The input image "ABC* of the tenninal A is processed in inoage display area 202A remains as 560Hx420V; Thus the 

the following manner. The cut-out size from the frame image magnification beconaes (16/12)x( 14/16). The varia- 

memory 42A is 400Hx3(X)V as explained before, but the 60 tion of the parameters of the window display control circuit 

cut-out position is shifted to the right The CPU 32A varies 56A becomes effective in synchronization with the syndiro- 

the setting of the X, Y coordmates of the cut-out area from nization signals 90A. 

the frame memory 42A, in the window display control The window display control circuit 56A reads the pixel 

circuit 50A througji the control bus 75A. Other parameters data of the new cut-out area from the fi^mc memocy 46A, 

are not changed. $5 and effects a skqjping/interpolating calculation correspond- 

The variation of setting becomes effective from the first ing to the image magnification (16/I2)x(14/16). The image 

synchronization signals supplied from the transmission sync data after the variation of magnific^uion is processed as 
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explained before, and is played in fterccdvod image display 
window 202A. 

With the variation of the cut-out area of the received 
image^ the data for the rectangular frame 208A indicating the 
cut-out area of the received image display are varied corre- 
sponding to the new cut-out area, and, on thp monitor 24A, 
the rectangular fram& 208A is displayed at a new position 
indicating the cut-out area of the received image display, in 
the received image display area indicating window 2<MA. 

Id the above-explained embodiment, the image magnifi- 
cation of the input image can be varied electronically by 
enlarging or reducing the transmission area of the input 
image, and the input image can be dectronicaUy tilted or 
panned by moving the transmission area vertically or hori- 
zontally. Consequently the effects of a zoom lens or a 
swinging mechanism can be obtained without these mecha- 
nisms. These effects are particularly effective in case of 
transmitting a moving image signal reproduced in an image 
reproducing apparatus. Also the transmission area within die 
entire input image can be constantly confirmed since the ^ 
transmission area is displayed as a rectangular frame on the 
monitor of the transmitting terminal Also since die image 
outside die transmission area is displayed, die surrounding 
or background image can be constantly monitored even 
during the transmission of a dose-up shot. 

Furthermore, as an arbitrary portion (display area) can be 
selected within the received image for monitor display, the 
arbitrary area of the received image can be observed with an 
sppropnatc magnification, independently from the transmis- 
sion terminaL Also the positional rdationshq) of die dis- 
played image in the received image can be constantly 
confirmed, as the lelationsh^ is displayed in an exclusive 
window. An effect similar to the swinging of the video 
camera in the transmission tcnninal can be achieved by 
veitically and/or horizontally moving the display area widiiii 
the entire received image. 

A part of the circuit shown in HG. 3 may natorally be 
..realized by a software, and the dimension and position .c^^die 
display windows 200, 202, 204 may be dynamicaUy varied 
as in the known window display systems. 

Also the present invcnticHi is not limited to an embodi- 
ment in which the display windows 200, 202, 204 are 
displayed in a monitar image frame, but there may be 
employed plural monitors or image display units. For 45 
exsnsfic, an exdustve display unit may be assigned for the 
display window 204. 

Also the window 204 for displaying the display area of the 
received image may be replaced fay a marie, indicating the 
display area of the received image, attached to die frame of 50 
the received image display window 202, and there may be 
provided a configuration in which die display area of the 
received image is expanded, reduced or moved by the 
manipulation of die marlc Same applies to the transmission 
area of the input image. These factors are merely a design 
concept in the graphical user interface. 

In the above-explained embodiment, the transmissicHi is 
conducted between the terminals A and B of an identical 
structure, but they may be mutually different in the display 
ability of the monitor 24, in the size of the windows 200, 
202, 204 etc The terminals have to be unified, however, for 
example in the nimobers of vertical and horizontal pixels of 
die image to be transmitted. 

As will be easily understood from the foregoing, the 
above-explained embodiment can dispense with the zoom 
lens or the swinging mechanism and can still attain die 
equivalent effects. Also the responsiveness is significantly 



improved, dae to the absence of delay in time, resulting from 
the control of such zoom lens or swinging mechanism. 

Also there is obtained an advantage that the performance 
is not affected by the functions cf the partna tenoinal, 
because the desired effects can be attained by electronic 
processes within the own terminaL This factor is particularly 
useful in case of connecting different models of terminals. 

Also in the foregoing embodiment, the sizes of the 
windows 206A, 206B are automatically oontrdled by the 
graphic display control circuit 60, according to die com- 
pression rate the conqxression encoding circuit 12 which 
effects compression encoding of the moving image. 

Also the size of die window 206A may be controlled 
according to the transfer rate of the commnnicadon channeL 
What is claimed is: 

1. An image communication jq)paratus comprising: 
input means for iiq>utting an image signal; 
setting means for setting a desired area from the image 

signal; 

extraction means for extracting the desired area set by 

said setting means, from the input image signal; 
transmissioii means for transmitdng the extracted image 
signal; 

first display means for displaying a relative position 

between the image signal and die desired area; and 
second display means for displaying the extracted image 
signal, 

wherein die image signal displayed on said second diqday 
means changes according to a change of the desired 
area. 

2. An image comnuinication apparatus according to claim 
1, fiirdier conqirising: 

reproduction means for reproducing die image signal, 
inputted by said input means, as a visible image. 

3. An image communication apparatus according to claim 
1, wherein the image signal is a coUx image signaL 

4. An image coinrnunication apparatus according to claim^ . 
^ 1, wherein said input nieans is a video camera. 

5. An image communication apparatus according to claim 
1, wher^ said first display means is ad^ed for providing 
^afiuc disi^ay of the area set by said setting means. 

6. An image communication apparatus according to claim 
1, finrther comprising: 

reception means for receiving an image signal from the 
outside dnough a communication channeL 

7. An image communication apparatus according to claim 
6, fiirthcr ccmqnsing: 

display means for displaying an area of an image repre- 
sented by the image signal received by said recepdon 
means. 

9. An image communicadon method conqxrising the steps 
of: 

inputting an image signal; 
setting a desired area from die image signal; 
extracting the desired area from the image signal; 
transmitting the extracted image signal; 
displaying a relative position between the image signal 

and the desired area; and 
displaying tftie extracted image signal, 
wherein the extracted image signal disjdayed changes 

according to a change of die desired area. 
9. An image ccHnmunicadon apparatus con^irising: 
recepdon means for receiving an image signal from die 
outside; 
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setting means for setting an area in the jinage signal 

received by said reception means; 
first display means for di^laying which area is the area 

set by said setting means in an image represented by the 

image signal; and 

second display means for displaying the received image 
signal, 

wherein the image signal displayed on said second display 
means changes according to a diange of the area set by 
said setting means. 

10. An image communication ^paratus according to 
daim 9, wherein the image signal is a color image signal. 

11. An image communication apparatus according to 
claim 9, wherein said display means is adapted to effect 
graphic display <rf the area. 
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12. An image communication apparatus according to 
claim 9, further oon^sing: 

instruction means for instructing a variation of the area. 

13. An image communication method comprising the 
steps of: 

receiving an image signal from the outside; 
setting an area in the received image signal; 
displaying which area is the area set, in an image repre- 
* sented by the received image signal; and 
displaying the received image signal^ 
wherein tho received image signal displayed changes 
according to a change of the area set in said setting step. 

♦ * ♦ * * 
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